Robust Real-time 3D Detection of Obstructed Head and Hands in Indoors Environments
نویسندگان
چکیده
We address the need for robust detection of obstructed human features in complex environments, with a focus on intelligent surgical UIs. In our setup, real-time detection is used to find features without the help of local (spatial or temporal) information. Such a detector is used to validate, correct or reject the output of the visual feature tracking, which is locally more robust, but drifts over time. In Operating Rooms (OR), surgeons’ faces and hands are typically obstructed by sterile clothing and tools, making statistical and/or feature-based feature detection approaches ineffective. We propose a new method for head and hands detection that relies on geometric information from disparity maps, locally refined by color processing. We have applied our method to a surgical mock-up scene, as well as to images gathered during real surgery. Running in a realtime, continuous detection loop, our detector successfully found more than 97% of target features, with very few false positives (less than 0.7%).
منابع مشابه
Robust 3D Hand Detection for Gestures Recognition
The aim of this paper is to present a fast, robust and adaptive method for real-time 3D hand detection. Unlike traditional 2D approaches which are based on skin or features detection, the proposed method relies on depth information obtained from a stereoscopic video system. As a result, it provides the 3D position of both hands. It also deals with changes of lighting and it is capable of detect...
متن کامل3D Modeling of Building Indoor Spaces and Closed Doors from Imagery and Point Clouds
3D models of indoor environments are increasingly gaining importance due to the wide range of applications to which they can be subjected: from redesign and visualization to monitoring and simulation. These models usually exist only for newly constructed buildings; therefore, the development of automatic approaches for reconstructing 3D indoors from imagery and/or point clouds can make the proc...
متن کاملBilateral teleoperation control to improve transparency in stiff environment with time delay
This paper proposes a new bilateral control scheme to ensure both transparency and robust stability under unknown constant time delay in stiff environment. Furthermore, this method guaranties suitable performance and robust stability when transition occurs between soft and stiff environments. This framework is composed of an adaptive sliding mode controller and an adaptive impedance controller,...
متن کاملStereo-Based Head Pose Tracking Using Iterative Closest Point and Normal Flow Constraint
In this text, we present two stereo-based head tracking techniques along with a fast 3D model acquisition system. The first tracking technique is a robust implementation of stereo-based head tracking designed for interactive environments with uncontrolled lighting. We integrate fast face detection and drift reduction algorithms with a gradient-based stereo rigid motion tracking technique. Our s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Journal of Multimedia
دوره 1 شماره
صفحات -
تاریخ انتشار 2006